A quantum version of 
free energy - irreversible work relations 



Wojciech De Roeck 1 and Christian Maes 2 
Instituut voor Theoretische Fysica 
- - - K.U.Leuven, Belgium. 

O 

o . 

£N) , Abstract: We give a quantum version of the Jarzynski relation between the 

distribution of work done over a certain time-interval on a system and the difference 
, of equilibrium free energies. The main new ingredient is the identification of work 

^0 ' depending on the quantum history of the system and the proper definition of various 

\ quantum ensembles over which the averages should be made. We also discuss a 

£S| ' number of different regimes that have been considered by other authors and which 

are unified in the present set-up. In all cases, and quantum or classical, it is a 
general relation between heat and time-reversal that makes the Jarzynski relation 
\ so universally valid. 
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O . 1- Introduction 

Thermodynamic potentials such as the Helmholtz free energy are 
crucial in applications of thermodynamics. They give insight in what 
! processes are a priori workable, with what effects and under what cir- 

cumstances. Basically one is interested in two types of information. 
One is the expression of these potentials as a function of system- 
parameters. That determines the thermodynamic landscape and it 
yields the thermodynamic forces. A second type of information con- 
cerns the mutual relation between these potentials and the link with 
available work and entropy-energy transformations. For example, for 
a system that can extract heat from an environment at constant tem- 
perature T, the energy that is available to do work is exactly the free 
energy F = V — TS, that is its energy V minus the heat term TS 
where S is the entropy of the system. Furthermore, to study its equi- 
librium properties we should maximize the total entropy (of system 
and reservoir) for a given energy contents but that again is equivalent 
with minimizing the free energy at fixed temperature. 

If, as often happens, no very reliable computation of the free energy 
landscape can be made, the above provides immediate rescue. It suf- 
fices to measure the work done under isothermal conditions in changing 
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the parameters of the system and it will be equal to the free energy 
difference. That however is only valid if the thermodynamic process 
involved is quasi-static. In other words, the changes must be done 
very slowly, a situation that cannot be hoped for in many cases. It was 
therefore very useful that an extended relation between free energy and 
work was proposed and exploited in a series of papers since the pio- 
neering work of Jarzynski in 1997, jlj. That relation looks as follows: 



e -/3AF = {e -? W) (L1) 



In the left-hand side AF is what we want to know, the difference in 
free energies between two equilibria with parameter values Kf and Kj. 
The right-hand side is an average over all possible paths that take the 
system in equilibrium for a certain parameter value «^ in its initial 
Hamiltonian to a state where that parameter is changed into Kf. The 
work done W depends on the path if the process is not adiabatic (i.e. 
without heat transfer) or if it is not quasi-static. The protocol, i.e. the 
sequence of forcing in the time-dependent Hamiltonian, is always kept 
fixed. 

Derivations of the Jarzynski relation (jl.lj) have been made in vari- 
ous ways and in various approximations, see HI EJ EE El UH UHj- 
From such a relation free energy differences can be measured even 
in situations where the process of changing the parameters is not so 
well-controlled. That has already been experimentally realized in e.g. 
molecular systems HU [TOJ . 

A natural extension of (jl.lj) concerns the quantum regime. That 
appears possibly important and relevant when the system in question 
should be treated with the methods of quantum mechanics. In nano- 
devices the interplay between nanomechanics and thermodynamics be- 
comes all important. Yet, a more fundamental reason to be interested 
in a quantum version of (jl.lj) is the question that it poses on the quan- 
tum nature of path-dependence. We enter here the domain of quantum 
mechanics on histories. It is a priori not clear how to define quantum 
mechanical work that depends on a path that the system has followed. 
In the present paper we derive a quantum extension of (jl.lj) where we 
explicitly deal with that path-dependence and where we start from a 
time-dependent unitary evolution on the level of the system plus envi- 
ronment. 
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2. Previous results 



Various proposals for quantum extensions of the Jarzynski relation 
have appeared in the literature. We briefly bring up some aspects of 
such studies. 

In [T7| and following one introduces the probabilities 



that the system is found in the a— th eigenstate (p a of the Hamiltonian 
H at an initial time (when the system in in thermal equilibrium at 
inverse temperature 0) and then is found in the a'— th eigenstate (p' a , 
of the Hamiltonian H' at a later time. The operator U in ()2.1|) is 
the unitary operator for the time inhomogeneous evolution during the 
whole period. It is then an easy computation, done in [TTj, that 



That resembles (11.1)1 except for the important fact that the left-hand 
side averages over an exponential of a total (in time) energy difference. 
In particular there is no concept here of a path-dependent work. One 
interpretation is that the system in question is here really the total 
system (subsystem + heat bath) and one should follow the change 
in energy over the whole system. We think however that it is more 
useful to have a representation of work in terms of the coordinates 
(and history) of the subsystem only. After all, that is what free energies 
are all about thermodynamically. A second interpretation is that one 
thinks of the unitary evolution as working entirely on the subsystem 
itself and the heat bath is completely absent except for the inverse 
temperature (3. That can be called the adiabatic regime and we return 
to it in Section 14.3.11 

The presentation in J5| contains analogies both with what was de- 
scribed in [3] and with the adiabatic treatment of [T7j . In [3] a deriva- 
tion of (jl-ljl was given based on a time-inhomogeneous Markov process 
which satisfies, at each time, the detailed balance relation for some en- 
ergy function. That can be lifted to the quantum regime when the 
Markov process is seen as an effective description of a quantum system 
in contact with a heat bath. For example, the quantum weak coupling 
limit exactly reproduces the classical Markov process as dynamics for 
the system when in the energy basis for the system Hamiltonian. In 
that precise sense, |3] was the first quantum extension of the Jarzynski 
relation. Here one deals with an effective dynamics of the subsystem 
and we turn to in in Section 14.11 
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(2.1) 




(2.2) 
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Finally, in [^] the question of path-dependence of the work is an- 
alyzed in an operator-setting and it is pointed out that various am- 
biguities remain in the ordering of the operators. These ambiguities 
only seem to disappear in a quasi-static limit which unfortunately, is 
exactly the regime we are less interested in. While it is in principle 
possible to define a work-operator for the total system, the question in 
that setting remains whether its projection on the subsystem remains 
useful and its spectrum measurable. 

In the present paper we deal with a unitary evolution over the total 
system, subsystem plus reservoir, and we deal explicitly with a path- 
dependent work. That is new but the reason that the Jarzynski relation 
(jl.ll) is so universally valid remains the same as for classical systems. 
The basic observation is that the entropy production can be identified 
with the source of time-reversal breaking in the action governing the 
distribution of system histories, see [TJ [TJJ EH] . We briefly state that 
point here in a formal way to refer to it later when things become more 
explicit. 

We take the dynamics time-dependent through which work W is done 
on the system over a time-period while in contact with a heat bath at 
constant inverse temperature f3. The time-dependent dynamics starts 
with an energy function V{ and at time n the energy function is given 
by Vf. Let q(u,pi) denote the probability of a history (o>t)o (on a cer- 
tain level of description) of the system started in the state pi at time 
zero. We choose p, = exp[— (3Vi]/Zi. We now reverse the protocol (the 
sequence of forcing) and let q(ou,pf)) denote the probability of the his- 
tory uj when started in pf at time zero. We choose Pf = exp[—/3Vf]/Zf 
for the same temperature but with a different energy function. For 
the probability of the time-reversed trajectory Qu = (u} n - t )o, we then 
write q(Qu),pj). Introducing the action C, we have 

q { U ,p) = pMe-<*>\ $&±£jl = e-«V> (2.3) 

Q\w,Pi) 

with 

R(uj) = \npi(uj ) - \npf(uj n ) + jC(Qlu) - C(co) 

Then, 

InpoM - InpnK) = P\V f {u n ) - Vi(uj )} - /3AF, AF = ~ln-£ 

The change in energy Vf(uj n ) — Vi(uo) equals the work W minus the 
heat Q that flows into the bath. On the other hand, it can be argued 
that the source term of time-symmetry breaking £(Qu) — C(u) equals 
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the entropy production @Q, see (THj. Hence, we get from ()2.3j) that 

; Pn) _ e -/3W(ui)+i3AF 

Q(w,Po) 

But, by normalization, multiplying the above relation with q(u, pi) and 
summing over all u gives one; hence obtains. 

What remains to be done is to give a quantum expression for the 
above quantities and that is the subject of the present paper. In other 
words, we want to obtain an algorithm, valid for a system subject 
to the laws of quantum mechanics, through which we can measure 
the difference in equilibrium free energies. Moreover, we want this 
algorithm to be formulated on the level of the subsystem. That means 
that we must trace out the heat bath from the equality (|2.2|) . 

3. Formulation of the problem 

We model a possibly small quantum system in contact with a much 
larger heat reservoir kept at fixed inverse temperature (3. The Hilbert 
space of the subsystem is denoted by TCs and that of the environment 
by TCr, both are assumed finite dimensional. As usual the total real 
and self-adjoint Hamiltonian is a sum of three contributions, 

H t = H t s + H R + 7 # z (3.1) 

where the system-part Hf is parameterized by t = 0, 1, . . . , n and acts 
on Tis- The Hamiltonian of the reservoir H (acting on Hr) and the 
coupling H 1 between system and reservoir are assumed fixed. We will 
not need any explicit description of these terms. Setting 7 = decou- 
ples system and reservoir. The canonical density matrices describing 
equilibrium for the decoupled system are 

We are interested in the difference of Helmholtz free energies 

AF^-iln^ (3.3) 

The dynamics for the total system is unitary and time- dependent with 
unitary operator 

U t = e iXHt 

acting on Tis ® T~Cr- The parameter A is real and sets the energy-time 
scale. 
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While the left-hand side of (jl.lj) is clear and given by ()3.3j) the 
question is about the quantum version of the right-hand side: What is 
the averaging and what is the work? Different reduced dynamics for 
the subsystem can be imagined that are relevant in different types of 
regimes. 



4. Results 

4.1. Effective regime. Here we suppose that the dynamics for the 
subsystem is described via some effective dynamics. There are various 
candidates but one class of examples is obtained as the quantum ana- 
logue of a Markov process on Tig. These can be rigorously obtained 
under various conditions and in various limiting regimes. Following 
[2], one can start with a time-dependent Hamiltonian H t and take the 
weak coupling limit. Obviously the driving protocol has to vary on the 
same time scale as the dissipation processes through contact with the 
reservoir. What results is a time-inhomogeneous Markov process such 
that the instantaneous generator at time t satisfies detailed balance 
with respect to H(t). One way to implement that is to think of a se- 
quence vl -> <f° ai -> -> ¥ a2 -> • • • -»• ¥T n \ -> Va' 1 -» Va n where 
alternating in time, the transition is either thermal as for ip^ — > l f t at+1 , 
and is modelled by a completely positive map A t which satisfies the 
condition of detailed balance with respect to p t = e^ f3Ht /Z t , 

or is mechanical as for — > f 1 ^ 1 - That last transition is imagined 
instantaneously performed so that we define the probability of a tra- 
jectory uj as the product 

gJV)=Tr [P2M P tJ\ 



Expectations will be denoted by (-)d- The total change in energy is 
AV = V™ — V® and the total heat that flows in the heat bath in the 
thermal transitions (J4.1)) is 



^ [p^k-i{p::X)\ ■ ■ ■ (4.2) 

-0V° 



n 

t=i 



(4.3) 
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The total work is therefore defined as 

n-l 

W{u>) = Q(u) + AV = ^(C 1 - Vl) (4.4) 

t=o 

and is done over the transitions (p^ — > y^ 1 . We then have 

( e -^) D = e^ AF (4.5) 

The simplest way to prove (|4.5J) is to use the relation between entropy 
production and time-reversal as in [T21 H31 EJ IS] • Let Qu = (a n , . . . , ao) 
be the time-reversed trajectory. Similar to ()4.2j) we define a path-space 
measure starting from p n : 

-/3V n 

q°(&uj) = Tr [P l a M P k)\ • • • Tr IPZ-MPZJ^ 1 (4.6) 
and compute the ratio 

??M _ «v» -vo )^Tr [P£A n (P^J] Tr [P^A^)] 



qg{eu) Z Tr [P« n _A„,(P«J] ' ' ' Tr [P^A^)] 

By using detailed balance (|4.1|) at every time-step and the definitions 
()4.3|) - (j4.4j) . one arrives at 



e f3AV-0AF+0Q _ e /3W-/3AF 



Apply to that relation the normalization condition 



to conclude (|4.5jl . The proof above mimics exactly the scenario of ()2.3j) . 
The result is the very analogue of the main identity by Crooks in |3] 
but where the transition rates in (|4.2jl have a quantum mechanical 
expression. 

4.2. Repeated measurements. We come back to the set-up of (|3.1j) - 
(13. 2j) . Assume that each is non-degenerate and has projections P l a 
on its eigenstates cp^ with eigenstates V*. A trajectory or path for the 
subsystem is a sequence (a , . . . , a n ) where each a t runs over the possi- 
ble eigenstates of iff, t — 0, . . . , n. We now give a probability measure 
on such trajectories which is obtained by tracing out the quantum me- 
chanical probabilities for the whole system. 

Let Pe denote the projection on the energy-space in Tin for the reser- 
voir Hamiltonian H R with energy E. The probability to find the total 
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system initially in equilibrium for (|H.2jl and at later times in eigenstates 
^> l at for the system and with energies E t for the reservoir is given by 

Pp {a , . . . , a n - E , . . . , E n ) = Tr [G p° G*] (4.7) 
with G = P n an ® PeJJu ■ ■ ■ Pi ® Pe 1 U 1 P° OC0 ® P Eo 

When viewed from the subsystem, the probability for trajectory uo = 
(a , . . ■ , a n ) is thus (let e = (E , ...,E n )) 

= 5^^(«o, • • -,Oi n ;e) (4.8) 

e 

and when conditioning on cj, (|4.7j) gives expectations denoted as 

when g/?(a;) is non-zero. Finally, the expectations in the path-space 
measure (|4.8jl are written as 

(/)=J]/(a;)g^(a;) (4.10) 

The change in energy for the subsystem corresponding to the path uj 
is V™ n — V® where V* is the energy of ip^. We define a path-dependent 
work by the formula 

W(u) = VZ - Vl - iln(e-^-*)>( W ) (4.11) 

The interpretation follows the first law of thermodynamics. To 
change the parameters in the Hamiltonian Hf isothermally some heat 
must flow from the bath into the system. That is the second term in 
(j4.11jl . We can expect that the heat bath is dispersionfree with respect 
to the subsystem in the sense that through each step ip l at — > y^t+i of 
the trajectory u>, the corresponding change in energies E t+ i — E t of the 
reservoir is determined: 

-iln<e-^-^)H - (En - E )(u) (4.12) 

That gives the heat Q flowing into the reservoir. At the same time the 
energy in the subsystem changes, the first term in (|4.11|) . Combined, 
(|4.11j) gives the work performed on the subsystem. 

For flUZD - (gup , 

e-f >AF = (e- fiw ) (4.13) 



That means that the Jarzynski relation (jl.lj) is unaffected in the quan- 
tum regime when, in the averaging, the quantum mechanical probabil- 
ities are used. We will now verify f)4.13j) . 

We apply again the ideas around f)2.3j) . We define the time-reversed 
path-space measure from ()4.7|) by reversing the order in which the time- 
dependent dynamics is applied and by now starting from the density 
matrix p n of Q : 

pp{a , ...,a n ;E ,...,E n ) = Tr [G p n G*] (4.14) 
with G = P2 n ® PeJJv . . . ® P El KPl ® P Eo 

It follows immediately that 

p (Qu; Be) = p (u; e ) e -W»-^+^-^)|° (4 . 15) 

and hence 

{e -m ) = J2q^)e^- V " n) (e^ {En - Eo) )^) (4.16) 

U! 

= ^ P/3 (^,e)e /3 ( y "o- y -)e- /3 ^- s °) 

as required. 

The repeated measurements introduce another aspect of randomness 
in the distribution of work which is absent classically. Unless one is 
taking an effective dynamics like in Section 14.11 one will always need 
to take care of that aspect to define in any useful way what is meant 
by work that depends on the history of the subsystem. 

4.3. Special cases. There are a number of special cases that we treat 
separately. 

4.3.1. Adiabatic regime. We consider only the subsystem that was ini- 
tially brought in thermal equilibrium at inverse temperature (3 and that 
from time zero on is isolated from the environment. We take thus the 
same set-up as in Section El except that we cut the coupling with the 
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reservoir. The initial density matrix is 

and the dynamics is unitary on Tis and here denoted by Uf with 
t = 0,1,..., n changing as time proceeds. Uf need not commute 
with . Instead of f)4.8|) we now take the probability of trajectory 
uj = (ao, • • • , « n ) to be 

4{u>) = Tr [P« U* . . . PlXPl po {P: n U s n . . . P^PlY) (4.17) 

with expectations (•)$■ For u the change in energy of the subsystem is 
V n — Vq as was the first term in (|4.11|) . Then 

{e P(VS -V a "J )s = e -/3AF (4 _ lg) 

That identity is the generalization of Equation 2.7 in ^7j. Note that 
()4.18|) is true for an arbitrary family of unitary operators defining the 
time-evolution. It can be obtained from the following exact identity. 
Let G be an operator on 7i,s and write Tr [GP"] = G(a). Then, as 
one easily checks, 

G(a n ) e^oTr [P a "„A„_ 1 (. . . J* (A^f* Po -)] = ^ 

(4.19) 

for all super-operators At (acting linearly on density matrices) that 

leave the identity invariant, A t (l) = 1. 

One can generalize (|4.17jl and ()4.18|) by choosing here 

A t (A) = J2^r U r s AU?* 

r 

with /i* > and = 1, meaning that the unitary is employed 

with probability p} r at time t. These A's leave the identity invariant, 
so ()4.19|) applies and 

$M e^ v °o- v ^ = e -? AF (4.20) 

just like in (|4.17|) - (j4.18|) but now with probabilities 

= Tr K„A n _i(. ..P^A^PlpoP^P^ . . .)] 

Of course, if 7 in ()3.1|) is zero, then U t = Uf (g> U R factorizes and the 
treatments of Sections I4.1M4.2I reduces to the adiabatic case. The work 
is a difference of energies (instead of a path-dependent quantity) and 
there is no heat (Q = 0). 
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4.3.2. Quasi-static regime. We imagine then that the evolutions Ut are 
slow enough so that the system plus reservoirs relax into an equilibrium 
state with respect to H t . 

We think about the case of Section 14.21 Always, 

pp(w, e) = qp{uj)qp{e\u) (4.21) 

but in the quasi-static regime we have 

pp(a t ,E t ) = q f3 (a t )q l3 (E t \a t ) (4.22) 

which suffices to see that (e~^ En ~ Eo ')(u) depends only on (ujQ,uj n ). 
Again, there is no path dependence in the work W. 

4.3.3. No time- dependence. Suppose that ([3.1)1 does not contain a pa- 
rameter dependence and that the time-evolution is homogeneous (Ut = 
U)- 

Then of course AF = 0. For the effective Markovian dynamics of Sec- 
tion one sees immediately that W(uo) = for each u in ([4.4)1 . In 
the adiabatic case of Section 14.3.11 as well: V® — V£ n = with of — 
probability one when we ask that in ([4.17)1 the projections P* and the 
unitary evolutions mutually commute. In the case of Section 14.21 we 
can use conservation of energy V£. + Ei = constant, as in the first law 
([4.11)1 . when we ignore the (boundary) interaction term H 1 in the en- 
ergy balance. In that case we again get W(uS) = 0. 

Acknowledgment: We are much indebted to Karel Netocny for many 
useful discussions. 
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